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Abstract 

Aspects of assessment in physics are considered with the aim of designing assessments that will encourage a 
deep approach to student learning and will ultimately lead to higher levels of achievement. A range of 
physics questions are considered and categorized by the level of knowledge and understanding which is 
require for a successful answer. Taxonomy is then proposed to aid classification. 
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Introduction 

Assessment is an essential component of teaching in any institute for higher education. It is 
important for measuring the knowledge and ability of students but can also have a significant 
impact on other aspects of a student’s education, including the style of learning that is 
adopted and their overall achievement. It is common practice for students to tailor their 
learning to the fonn of assessment being driven to either a surface approach or a deep 
approach (Ramsden 1992). Students are generally capable of changing their approach from a 
surface approach to a deeper approach, if they perceive this as necessary to succeed in the 
assignment tasks (Smith et al. 1996). It has also been shown that surface learning is 
widespread within universities, but students who adopt a deep approach tend to achieve at a 
higher level within a year (Crawford et al. 1993). Directing students towards a deep learning 
approach through the form of the assessment tasks is important in all areas of education. The 
design of suitable assessment is often performed with the aid of taxonomy. While the goal 
may be the same in different subject areas, it is often necessary to tailor the approach 
depending on the topic area. For example, there are clear differences between exams in 
history and physics. It is therefore natural to expect that a different taxonomy would be 
required to categorize the assessment tasks. 

This paper investigates assessment in physics. A spectrum of assessment methods is 
considered with the main emphasis placed on examination. This is generally the principle 
method for determining student grades when certification is required. Historically 
examination has been used as the main mechanism for assessment and this is likely to remain 
the case since it ensures equity of treatment for students and provides a level of quality 
assurance and accountability. A number of examples of potential exam questions are 
considered along with the level of knowledge, skill and understanding that is required in 
answering them. From this a taxonomy is produced to aid classification. 

Unit Composition 

Any physics unit must satisfy a number of criteria. There is a body of knowledge that students 
must take from the unit. This can be divided into two main categories; information which the 
students require as a prerequisite for future units; and knowledge which would be expected of 
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a physics graduate wishing to continue their studies at a higher level, undertake research in 
physics or enter employment. It is, however, important that students take more from the unit 
than simply a bundle of knowledge. The students must also leam skills. This includes skills 
that they can apply in other units to different subject matter as well as skills that they can 
transfer to other arenas outwit the university. Students undertaking a physics major must 
acquire the skills necessary to undertake a career in physics. In addition, they must also learn 
skills that are required by most employers. These include practical components such as 
computing as well as other skills such as time-management, ability to work as a team, 
presentation skills and information literacy. Thus an educator must ensure that a portion of a 
unit must follow the traditional discipline-based approach (Toohey 1999: 49) while also 
incorporate aspects of the personal relevance approach (Toohey 1999: 59). 

Assessment Design 

From the point of view of the students, certainly for surface learners, the curriculum of the 
units is defined by the assessment (Ramsden 1992: 187). It is therefore essential that the 
assessment tasks cover the whole curriculum, both in terms of knowledge and skill bases. A 
non-exhaustive list of assessment methods commonly applied to physics unit is listed below, 
along with a discussion of their merits. The assessment can have two objectives: summative 
or formative (Biggs 2003: 141). Summative assessment provides results that are used to grade 
students while formative assessment provides students with feedback during the learning 
process. Assessment can take many forms; written, on-line, oral presentation; however, they 
can generally be divided into three types: assignments; laboratory/project reports; and 
tests/exams. 

Assignments'. A number of assignments throughout the unit provide a useful method for 
ensuring that students are keeping pace with the unit. They also provide essential feedback to 
the student since they indicate the level of knowledge or ability that is expected from them 
and also the extent to which they are achieving this. Assignments should be mainly for 
formative purposes. Since they provide important infonnation for both the student and the 
lecturer regarding the progress of the students, these should be a compulsory part of the 
assessment, possibly with some weight in the overall summative assessment. This gives the 
students an incentive to put effort into the assessment ensuring that the student gains 
maximum benefit and that the formative aspects of the assignment are meaningful. The ability 
to build up marks prior to a final exam is also beneficial to the student and can make any final 
exam less threatening. When designing and marking assessment it is important to ensure that 
assignment questions cover as much of the material as possible and are of a similar standard 
to the test/exam questions. This ensures that students are given a clear indication that the 
whole of the curriculum is important. It also gives the students an opportunity to judge how 
they are performing in the unit and offers a source of feedback in areas where they are having 
difficulties. 

Laboratory/Project Report : Practical work is an important aspect of physics and so its 
assessment of this aspect should reflect this importance. Assessing practical work generally 
assesses skills rather than knowledge. Some knowledge of the subject matter is required to 
undertake the practical work, but significantly less than any other part of the unit assessment. 
The skills assessed are also generally different to those assessed in a test or exam. The main 
skills assessed are communication, teamwork and practical ability. Assessing laboratory work 
is commonly done through marking a formal report. To produce a high quality report a 
student must work well during the laboratory session and exhibit skills such as teamwork. 
Laboratory assessment provides the students with the opportunity to exhibit different skills to 
the other assessments. Giving them a significant weighting must recognize the importance of 


8 





European J of Physics Education Vol.2 Issue 1 2011 ISSN1309 7202 



these skills. Aspects of the assessment of laboratory work are also fonnative. Ensuring that 
practical assessment is done in small chunks, for example, every week, allows students to 
leam from the assessment and improve their skills in the same manner as discussed for 
assignments. This means that the assessment can be both formative and summative. 

Exams and tests: These methods of assessment are primarily summative. They are used solely 
to measure the knowledge and acquired skills of the student. Assessment through tests and 
exams will be examined in the remainder of this paper. 

Reflections on Assessment through Tests and Exams in Physics 

Having determined that the test and exam cover the material of the unit and that of the course 
description, it is interesting to investigate the level of knowledge and understanding which a 
student requires to answer exam or test questions. 

Two frameworks have traditionally been used for evaluating the different level of 
questions and the corresponding answers in a range of educational settings. These are 
provided by the SOLO Taxonomy of Biggs and Collis (1982), and by Blooms Taxonomy 
(Bloom et al. 1956). Before considering assessment in test and exams in physics the two 
taxonomies will briefly be reviewed. 

Biggs SOLO Taxonomy 

Five levels are identified: 

Prestructural level 

Students acquire pieces of unconnected information 
No organization 

Unistructural level 

Students make simple and obvious connections 
The significance of the connections not demonstrated 

Multistructural level 

Students make a number of connections 

Significance of relationship between connections not demonstrated 
Relational level 

Students demonstrate relationship between connections 

Students demonstrate relationship between connections and the whole 

Extended abstract level 

Students make connections beyond the immediate subject area. Students generalize and transfer principles from 
the specific to the abstract 

Bloom’s Taxonomy 

Six levels are identified: 

Knowledge 
Recall of data 

Comprehension 

Understanding the meaning 

State a problem in one’s own words 

Application 

Use a concept in a new situation 

Applies what was learned in the classroom into novel situations in the workplace 


9 





European J of Physics Education Vol.2 Issue 1 2011 


ISSN1309 7202 



Analysis 

Separates material or concepts into component parts to understand structure 
Distinguished between facts and inferences 

Synthesis 

Builds a structure or pattern from diverse elements 

Put parts together to form a whole, with emphasis on creating new meaning or structure 
Evaluation 

Make judgments about values, ideas or materials. 

It is important to consider that the term ‘application’ in Bloom’s Taxonomy is used in a 
different sense to how it may be used in a syllabus or unit description. In the latter it may be 
used, for example, as ‘application of Maxwell’s equations’ or ‘application of Newton’s laws’. 
In terms of an exam question this could involve a problem similar to, or even virtually 
identical to, a problem that the student has already seen, for example in an assignment 
question or as a lecture example. The implication in Bloom’s Taxonomy that the situation or 
problem is ‘new’ is not present in this definition. It is also important to notice that the word 
‘analysis’ is often used to describe mathematical manipulation. 

Both Taxonomies apply to cases where the answer to a question can have a range of 
answers that illustrate the different levels of the student’s thinking. The following example is 
based on material from Biggs and Collins (1982). Two answers to the question ‘Why is the 
side of a mountain that faces the coast usually wetter than the side facing the interior’ are: 

Because it rains more on the coastal side. 

Because the prevailing winds are from the sea, which is why you call them sea breezes. 
They pick up moisture from the sea and as they meet the mountain they’re forced up and get 
colder because it’s colder the higher you get from the sea level. This makes the moisture 
condense which forms rain on the side going up. By the time the winds cross the mountain 
they are dry. 

Answer 2 clearly shows a deeper understanding of the process, while answer 1 simply states a 
fact. 


Both taxonomies have been applied to a wide range of topics; however, there are some 
limitations. This has been observed in the field of mathematics by Smith et al. (1996) who 
proposed a modification to Bloom’s taxonomy for structuring assessment tasks in 
mathematics. Smith’s MATH (mathematical assessment task hierarchy) taxonomy (Smith et 
al. 1996, Wood et al. 2002) consists of three groups A, B and C as detailed below: 

Group A 

Factual knowledge 

Comprehension 

Routine use of procedures 

Group B 

Information transfer 
Application in new situations 

Group C 

Justifying and interpreting 
Implications, conjecture and comparisons 
Evaluation. 
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Like mathematics, the application of both Bloom’s and Biggs’ taxonomies have 
limitations when applied to physics assessments, particularly above the elementary level. In a 
typical physics unit, for example, electromagnetism, there is no scope for ‘evaluation’ or 
‘extended abstract level’ arguments as defined in the taxonomies. This level of reasoning may 
be applicable in areas of physics that are current areas of research such as the Big Bang 
Theory or the Grand Unified Theory. Advanced units in these, or similar topics, may include 
the latest theories and possibly evidence that contradicts established theories. These are topics 
of current research. In an exam question a student might describe such evidence, for example 
an experiment demonstrating CP violation, and discuss its consequences. Such an answer 
could demonstrate ‘comprehension’ and ‘multiscructuraT, or even ‘relational’ thinking. This 
answer would consist of arguments initiated by others, and not by the student answering the 
exam question, and so in terms or the taxonomies could not be classified as ‘analysis’ or 
‘synthesis’. It could not be expected that an exam answer would exhibit ‘evaluation’ or 
‘extended abstract level’. Further, in a unit such as electromagnetic theory, the material 
covered is well established and there are no areas of speculation. It is also not practical to 
question the use of concepts such as electric fields. 

Often a question can only be answered at a single level. For example, consider a 
question asking for the force on a particle of charge q, moving with velocity v in a magnetic 
field B. The correct answer is that F = qv/\B. A student could state this and then continue 
‘Now if we observe this from a reference frame in which the charge is at rest the magnetic 
force will be zero. Thus we can conclude that the apparent magnetic force is actually an 
electrostatic force which can be understood due to a Lorenz contraction”. This level of insight 
was not asked for in the question and so no marks can be given for it. In a unit where the 
ideas expressed by the student had not been covered, this answer might appear to be at the 
extended abstract level in Biggs’ taxonomy or synthesis/ evaluation in Bloom’s Taxonomy. It 
is, however, unlikely that this answer represents a flash of inspiration on the part of the 
student during the exam. It is more likely that the answer represents information, which the 
student has read and is repeating (possibly with no understanding of its meaning). In either 
case no marks can be awarded for this insight. The example, however, illustrates the 
limitation of applying either Bloom’s or Biggs’ taxonomy. 

The project report is one area of physics where Bloom or Biggs’ taxonomies can be 
truly applied. Here the students have a chance to display a high degree of reasoning and 
judgment concerning the interpretation of their results. For example, the student may criticize 
the procedure and suggest improvements; compare with other techniques/ methods; and 
identify other fields where such methods can be applied. This is typically the only opportunity 
a student will have to demonstrate ‘extended abstract’ or ‘evaluation’ within the evaluation 
process. 

Although mathematics and physics have a number of similarities, the differences 
between them mean that the application of Smith’s MATH taxonomy to a physics unit also 
encounters limitations. In the following section, different types of physics questions will now 
be considered with a view to determining a taxonomy suitable for structuring assessment in 
physics. 

Taxonomy for Physics 

The concept considered in this section can be applied generally to most topic areas in physics; 
however, the examples considered will be taken from electromagnetic theory. 
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In physics exams and tests it may be possible to ask question similar to the one above giving 
students the opportunity to answer according to their level of knowledge, understanding and 
insight. For example, consider the following question: 

Al: Describe the three major classes of magnetic materials, giving details of their differences 
and the physics behind these differences. 

This question offers students a chance to display their knowledge and/or understanding at 
different levels. Students can list facts they have learnt about magnetic materials - factual 
knowledge. There is also scope to demonstrate comprehension in the second part of the 
question explaining the physics behind the differences. 

While it is possible in some instances to use questions such as the example above, generally 
it is only possible to answer a question on a single level. Consider the following questions: 

B1: State the expression for the electric field E at position r due to a point charge q at position 


B2: Sate Gauss’s Law 


B3: State the Lorentz force equation, describing each parameter and stating any requirements 
with regards the particle’s motion. 

B4: State Ampere’s circuit law. 

Each of these questions require a statement of facts and the answers would be classified as 
factual knowledge 

To enable students to demonstrate a higher level of understanding it is necessary to extend 
the scope of the question with a second part which either leads on from the initial statement of 
facts (B1-B4) or can be the starting point for the question. Consider the following examples 
that could be set as a second part to questions (B1-B4): 


Cl: Consider a region containing two different dielectrics characterized by ei and Qi. By considering 
the normal and tangential components of E at the interface and applying Maxwell’s equations in 
integral form, determine the boundary conditions at the interface. 


Cl': A total charge Q is spread evenly over the surface of a disk of radius a defined by x 2 + y 2 < a 2 , 
z = 0. Find the electric field on the axis of symmetry (z=0). Hence, or otherwise, show that the 

Q ' 


potential on the axis is given by 


2 JTEr, 


( 2 , 2V /2 

[z + a ) 


, where f(°°) = 0. 


C2: a) Explain how Gauss’s Law leads to the relationship JTD-dS=J> v dv. 
b) Consider a sphere with radius a and uniform charge density r v . Detennine D everywhere. 

C3: A charged particle moves with a uniform velocity 4a x m/s in a region where E = 20a y V/m and B = B 0 a z 
Wb/m2. Determine B 0 such that the velocity of the particle remains constant (Sadiku 2001: 313). 

C4: A hollow conducting cylinder has inner radius a and outer radius b and carries current I along the positive z- 
direction. Derive expressions for H everywhere. 
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Questions C1 and C2 a) can be classified as bookwork. The answer to these questions 
can be found in any standard textbook and will (presumably) have been covered in the 
lectures. As such a student could memorize the answer and reproduce it without any 
understanding. In this case the answer would not show any greater level of knowledge or 
understanding than the answers to questions B1-B4. In practice, unless a student memorizes 
every page of the textbook and/or the lecture notes, simply reproducing the proof from 
memory is not possible. Despite not being able to recall the answer verbatim, a student will 
have some memory of looking or working through the appropriate section of the textbook. 
Guided by this memory or by the approach suggested in the question {By considering the 
normal and tangential components of E at the interface and applying Maxwell’s equations in 
integral form), which may be omitted to change slightly the level of difficulty, the student 
must also exhibit a level of knowledge and understanding to produce the required answer. 
Thus a bookwork question generally requires more than simply reproducing factual 
knowledge, it also requires comprehension of the material and the ability to reproduce some 
standard work. 

Questions Cl', C2b), C3 and C4 require the use of the facts that were asked for in 
questions B1-B4 respectively. This would normally be termed an application of the 
electrostatic force equation, Gauss’s Law, Lorentz force equation and Ampere’s circuit law 
respectively. Crucially, it should be noted that each question may or may not contain the 
novelty required in Bloom’s taxonomy. The ability demonstrated by a student correctly 
answering one of these questions cannot be determined solely by examining the questions. 
Undoubtedly methods for using these laws to determine physical properties will have been 
presented to the students previously, either through examples in the lecture/ textbook or 
through assignments questions. The questions must be subdivided into three categories: 

A question that is identical or virtually identical to a question that the student has 
already been exposed to or has already solved. This can be classified as application - 
previously solved. 

A question that is broadly similar to a question already encountered, classified as 
application - routine procedure. 

A question that is significantly different (in terms of the application of the law or the 
method of mathematical solution) that it can be classified as application - novel. 

If two students give the same answer to a question they should both be awarded the 
same mark. If the students have different background the level of understanding exhibited by 
the students to obtain the same number of marks is different. Within any single class, 
however, the background of the students (at least with respect to the subject taught in the unit) 
should be similar. All students will have attended the same lectures, been directed towards the 
same textbook, and attempted and seen the solutions to the same assignment questions. 
Backgrounds will vary slightly where students have accessed alternative resources, for 
example, alternative book in the library. In this case a question that is ‘application - novel’ for 
one student may be classified as ‘application - routine procedure’ for another. In such a case 
the student with a larger pool of background knowledge is benefiting from this extra reading 
and understanding of the subject. 

A further category requires a student to take their knowledge and understanding of one 
area and relate it to another. For example consider D1 and D2 below that could follow 
questions Cl' and C2. 

Dl: Given the azimuthal symmetry of the problem, the potential must take the form 


coefficients A n and B n . 




n =0 


" j P n (cos 6) for a « r, where P n is the Legendre polynomial. Determine the 
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D2: For r > a describe how the solution relates to that for a point charge. 

D2 requires the expression for D that has previously been calculated in terms of the charge 
density to be compared with the expression for a point charge Q that must be known. This 
involves determining a relationship between the total charge and the charge density. It 
requires relating the answer given in the previous part of the question to knowledge obtained 
elsewhere in the unit and determining the consequence of the comparison. This can be 
categorized as ‘relation - within topic’. (Provided this comparison had not been considered 
previously in lectures or an assignment in which case the question would be categorized as 
‘application - previously solved’.) 


D1 requires an understanding of the solution of the Laplace equation in spherical 
coordinates. Although the fonn of the general solution is given, it would be difficult to answer 
the question without some understanding. This could relate to a different part of the unit, or 
possible a different unit on another topic, for example, mathematical methods. Knowledge 
and understanding of Legendre polynomials and the Binomial expansion and double factorials 
are also required. This is something that would most likely have been covered in a different 
unit. Thus a full answer required the student to bring together knowledge and understanding 
from other aspects of their physics course and also to determine a method to relate the two 
forms for the potential. This type of question can be categorized as ‘relation - outwit topic’. 
Given the limited time constraints of a test or exam it may be desirable to include a number of 
hints that will decrease the difficulty of the question without changing the level of 
categorization of the question. This could include all or some of the following: Expanding 
your solution for f using a Binomial expansion, noting that ^(ocj = (), and comparing the 


solutions on the axis (r = z), show that B n = 0 and A n 


0, for n odd 


(-l)'" (n + l)!a 
(n + l)(n/2)! 


, for n even. 


It has been suggested that by altering the form in which a question is put, it is possible to 
change the level of understanding that a student displays in an answer (Pollard 1993). This 
work refers to first-year level physics and deals with the problem of students simply 
remembering formulae and inserting values to obtain a correct answer without understanding 
the underlying physics. Both questions C2 and C4 require more than simply putting numbers 
in an equation. The students need to understand the concept of a Gaussian surface or 
Amperian path, the symmetry of the problem and the appropriate integral to perform. Pollard 
(1993) suggests re-writing a question to explicitly ask about the Gaussian surface. This 
prevents students from answering the question without understanding the concept. In, for 
example, C2 it is necessary for the students to use two different Gaussian surfaces. Thus the 
student needs to understand and use the concept to correctly and fully answer the question. 
Hence a student must display a higher level of thinking/ understanding to answer this 
question, without the need for Gaussian surfaces to be mentioned in the question. Further, by 
not mentioning Gaussian surfaces in the question it is necessary for students to be aware that 
this is what is required. 

Conclusion 

A progression has been highlighted in the type of exam questions that provide the opportunity 
for students to express higher levels of knowledge and understanding. These correspond to a) 
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factual knowledge; b) comprehension; c) book work; d) application - previously solved; e) 
application - routine procedure; f) relation - within topic; and g) relation - outwith topic. 

It is important to implement procedures that encourage deep learning rather than surface 
learning. Toohey (1999: 13) indicates that surface learning is encouraged by assessment 
strategies that reward low level outcomes. Thus it is important to ensure that assessment tasks 
require the students to produce high-level outcomes. It is hoped that the taxonomy detailed 
here will be an aid to designing assessment tasks in physics and therefore help encourage 
deep learning for students. Other aspects, which encourage a deep approach to learning, 
include (Biggs 1989): an appropriate motivational context; a higher degree of learner activity, 
interaction between peers and teachers; and a well-structured knowledge base. It is important 
to also consider these features within a unit. 
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